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Abstract. - Cooperative effects in neural networks appear because a neuron fires only if a minimal 
number m of its inputs are excited. The multiple inputs requirement leads to a percolation model 
termed quorum percolation. The connectivity undergoes a phase transition as m grows, from a 
network-spanning cluster at low m to a set of disconnected clusters above a critical m. Both 
numerical simulations and the model reproduce the experimental results well. This allows a 
robust quantification of biologically relevant quantities such as the average connectivity k and the 
distribution of connections p^. 



Large networks generate complex behavior, as is ap- 
parent in diverse systems such as computers, society and 
biology [T]. In particular, the integration of information 
from several neighbors leads to highly correlated and col- 
laborative activity [2]. In general, the complexity and ca- 
pacity of the network increases steeply with the degree 
of inter-connectivity, as does the difficulty to understand 
these complex networks. Biological neural networks stand 
out as intriguing complex systems [3]. From cultures in a 
dish [4] all the way to the brain [5], neural networks dis- 
play a rich repertoire of activity and functionality, which 
arises from the interplay between hundreds to millions of 
neurons. In the simplest picture of a spiking neuron, stim- 
uli (inputs) from connected neurons are "integrated" in 
the target neuron, which fires once a threshold voltage is 
reached and then propagates the electric signal on to other 
neurons [B]. 

Imposing the need for a large quorum of m input nodes 
to fire leads to a percolation problem, which we term "quo- 
rum percolation" (QP). This name also hints for the po- 
tential uses of QP to treat the spread of diseases, rumors 
and opinions. In this work we show how the multiple in- 
puts requirement modifies significantly the function of the 
network. The QP approach takes the number of inputs re- 
quired for firing m as its control parameter and can then 
explain phenomena such as the transition to a giant m- 
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connected component (GmCC), a continuum of connected 
neurons spanning a significant fraction of the network. 

The QP setting is similar to that of bootstrap percola- 
tion (BP) in which nodes with less than k neighbors are 
iteratively "pruned" from a graph until there remains only 
its highly interconnected "fc-core" ( (THTO] and references 
therein) . The propagation of firing in QP is analogous to 
the advancement of the pruning process in BP (see [12]). 
In practice, however, physical realizations of BP are usu- 
ally limited in their connectivity, often on the order of 
A: = 2 — 3. In contrast, the average connectivity in the 
neural network studied here is much higher. A: = 50 — 150 
[llj , and results in a very different behavior of the network. 
A variation on the problem was posed in [12) . where the 
propagation depends on the fraction of ignited neighbors 
and was solved using the approach presented in jl3| . 

Model. — The neural network is modeled as a random 
directed graph ,14j whose nodes are neurons connected by 
synapses. The input degree distribution is p^. Each neu- 
ron is assigned a probability / = f{V) to fire in response 
to the direct excitation by an externally applied electrical 
voltage. The total probability of a single neuron to fire, $, 
is the sum of f{V) and of its response to the input from 
the firing of "neighboring" (i.e. connected) neurons. This 
response is characterized by the collectivity '^rn{^), the 
probability that there is a quorum of at least m inputs to 
a neuron that fire and thus excite the neuron. ^„j((f>) is 
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the synaptic excitation probabihty, which is the signature 
of collective effects in the network. Therefore, $(m, /) is 
given by: 



$K/) = /+(l-/)vI/,„(<D) 



= /+(i-/)Ep'^E ,p'(i-*) 



k—m l—m 



\k-l 



(1) 



Equation ([I} represents the fixed point of an iterative fir- 
ing process that starts with the external ignition of a frac- 
tion f{V) of neurons and propagates by igniting at ev- 
ery step those neurons that accumulated at least m fir- 
ing inputs. Equation ([TJ exploits the effective tree-like 
topology of the random network to ignore the presence 
of feedback loops and of recurrent activity in the neu- 
ral culture. The validity of the random graph approxi- 
mation to metric graphs such as the experimental neural 
networks is discussed in detail in 10 . It proves conve- 
nient to express the collectivity ^m(<i>) in terms of the 
generating function J{z) of the degree distribution pk, 
J{z) — J2k Pk ^'°; which results in a truncated Taylor ex- 
pansion *„($) = 1 - El^o'(*V'!)5'^/5^'li-*- 

We previously }14j treated a simplified version of equa- 
tion dl]) for the standard bond percolation case of m = 1 , 
and observed a percolation transition both in the model 
and the experiment. The percolated phase is character- 
ized by a giant connected component that spans a non- 
zero fraction of the network. Note that the GmCC is very 
different from the conventional m = 1 giant connected 
components. 

Here we treat the case of an arbitrary m and find how 
excitation by multiple inputs changes the response of the 
neural network. Within the framework of the model, all 
distributions of connections p(k) in the network are pos- 
sible. However, when coming to compare to particular re- 
sults in a quantitative manner the need to choose a specific 
distribution arises. This allows numerical simulations of 
the model and a comparison to data from the experiment. 
The correct choice was determined previously [Til [14] to 
be a Gaussian, based on numerical simulation comparing 
data from experiment — both the giant component size g 
[TT] and the cluster size distribution ps [H] . After trying 
a variety of distribution functions (including the natural 
candidates, i.e. power laws, exponential and Poisson), we 
concluded that the gaussian distribution gave the best de- 
scription. 

Following the experiment, we specify the degree distri- 
bution Pk and solve for $(m, /) as a function of m and /, 
the experimental control parameters. Based on our previ- 
ous experimental observations [TTJ[14], we assume a gaus- 
sian distribution pk ^ exp[— (fc — fc)^/(2cr^)] with fc = 50 
and a = 15. 

To find the firing probability ^{m, f) for given values 
of m and /, we rearrange equation ([T]) as /(to, $) = 
($ - ^™($))/(l - *™($)). In Figure [Ha), /(m, $) 
is plotted and graphically inverted to find the solution 



^(to,, /). The solution shows that both parameters / and 
TO, have transition values, f*{m) and rric, where the solu- 
tion changes qualitatively. For m < rric, the curve <I>(?ti, /) 
is non-monotonic and below the transition, / < f*{m), 
there exist three solutions: The lower one corresponds to 
$ ~ / and represents a system where only the externally 
excited neurons fire. In this solution the external voltage 
V is only able to ignite 'sensitive' neurons, i.e. neurons 
with a low excitation threshold. After they fire, the sig- 
nal dies out without propagating throughout the network. 
The second, intermediate solution lies in a non-physical 
region in which the firing probability decreases with the 
external electrical stimulus /, i.e. d^/df < 0. The third, 
higher solution corresponds to the synaptic excitation of 
most of the neurons. This solution signals the ignition 
of the giant connected component of the network. The 
two available physical solutions, the un-excited network 
$(/) ~ / and the excited network $(/) ~ 1 coexist below 

rim). 

The first two solutions merge and disappear at / = 
f*{m) [Fig. [DJa)] and for / > f*{m) only the third so- 
lution is available. Physically, at this point the external 
voltage is high enough to excite the GmCC and the whole 
network percolates. As a precursor to the transition, $(/) 
deviates from the expected $(/) — /. This deviation sig- 
nals the ignition of small clusters h that contain the most 
excitable neurons. At the critical value f*{m) the system 
undergoes a phase transition, from the low excitation state 
characterized by $ ~ / to the percolation solution $ ~ 1 
where almost all neurons fire [Fig. [l](b)]. The behavior 
of the network can be seen as a first order phase transi- 
tion that exhibits a discontinuity in the value of $. Note 
that, in contrast to the traditional to = 1 percolation, for 
TO, > 1 the GmCC does not appear at zero excitation. The 
requirement of multiple inputs imposes a minimal excita- 
tion /*(to), or threshold voltage, to excite the GmCC, 
which may "immunize" the neural network against exci- 
tation by noise. 

The size of the GmCC g decreases as to, grows, and 
reaches g — at a critical value m = rric. Graphically, 
at / = f*{mc) the two physical solutions (as well as the 
unphysical third one) merge into one [Fig. [TJa)], and for 
higher values of both / and to, only one solution exists. For 
TO, > TO,c the demand for multiple inputs is so restrictive 
that the network has no giant connected component. The 
network breaks off into isolated clusters that are ignited in- 
dependently. This scenario corresponds to a second order 
phase transition, characterized by the order parameter g, 
with 5 = for to, > rric and g > for rn < rric- At the ex- 
treme of TO :s> TOc the network is completely disconnected, 
neurons are ignited in response to the external excitation 
only, and the solution $ ~ / applies for all values of /. 

The non-monotonic curve of $(/) is similar to the 
van der Waals density-pressure isotherms, which exhibit 
a gas-liquid coexistence region below a critical tempera- 
ture (equivalent to rric). The non-physical segment of the 
isotherm is resolved by Maxwell's construction which con- 
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nccts the coexisting phases by a vertical line, signifying a 
first order phase transition. In a similar way, we replace 
the coexistence region of the $(/) curves by a vertical 
line, connecting the two physical solutions of the system 
(dashed lines in Fig. [Ua)). This line identifies the size 
of the GmCC g. In contrast to the traditional liquid-gas 
transition which occurs at around the center of the coex- 
istence region, our simulations show that ignition of the 
GmCC occurs very close to f*. 
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Fig. 1: Quorum percolation model, (a) Black lines: Family 
of solutions ${m, f) for increasing m and a gaussian degree 
distribution Pk{k) with fe = 50 and a = 15. Dashed lines 
connect the physical solutions in the coexistence region. The 
jump in $ for each value of /* identifies g, the size of the 
GmCC (blue bars), and the contribution of the small clusters 
h. For example, for m = 20 at / = $ grows continuously 
from zero, so that at / = there is no GmCC. At / « 0.15 
the GmCC appears, and $ jumps practically to 1. While the 
clusters comprising h are isolated, the GmCC was observed in 
the simulations to be connected. The black dots and the red 
line indicate the transition points f*{m) and nic. (b) Schematic 
representation of the ignition of the network as a function of /, 
for a network with fc = 5 and input threshold rn = 3. Ignition 
occurs in two phases: first the external ignition of a fraction 
/ of neurons and in the second, the expansion of the firing 
m-connected cluster (GmCC). For / ~ only the neurons 
(circles) with the lowest excitation threshold are ignited (blue) 
and pass the signal (blue arrows) . As / increases more neurons 
get excited. These neurons, in turn, excite synaptically other 
neurons (red), but the activity is confined to isolated clusters. 
At / = /* enough neurons fire for the network to percolate and 
a GmCC emerges. Weakly connected neurons and with high 
firing thresholds will fire only at large /. The outlined areas 
show the neurons that fired together for each /. (c) Three- 
dimensional representation of the solutions of the model as a 
function of m and /. The white curve shows the values of the 
transition points /*. 



Figure HJc) summarizes the response of the network as 
a function of $, to and /. The white curve shows J*{m), 
and identifies the first order phase transition in the size 
of the GmCC. This curve disappears at to = TOc, where 
the network undergoes a second order, continuous phase 
transition. The point m = to-c is analogous to the classical 
tricritical point of thermodynamic phase transitions. 

Experiment. — The ideas of QP are tested on a typ- 
ical two dimensional in vitro culture comprising of over 
5 X 10^ neurons. The experimental system (see Refs. 



[TTl[T4j[T6] for details) is a culture of neurons that are ex- 
tracted from rat embryonic brains in day 17 or 19 of preg- 
nancy. Neurons are plated on a glass coverslip and create 
a highly connected two-dimensional network in about 2 
weeks. Activity can be stimulated globally in the culture 
by an external voltage V that is applied across two bath 
electrodes. 

We assume that a neuron integrates over its input con- 
nections, has a threshold voltage Vt to be ignited, and 
that on average each input into a neuron contributes a 
voltage 5syn- Thus, toq = Vt / Qsyn inputs are initially re- 
quired to excite a neuron and propagate the signal in the 
network. The synaptic strength can be reduced by ap- 
plication of a blocker (CNQX) for the synaptic (AMPA) 
glutamate receptor. Administering CNQX in increasing 
concentration gradually decreases the synaptic bond be- 
tween neurons, and thus increases the number of inputs to, 
needed for a neuron to fire. The relation between the in- 
put threshold to, and the concentration of CNQX is given 
by m = mo(l + [CNQX]/i^d) [11], with Kd = 300 nM. 
We use mo ~ 15 as the the initial input threshold for the 
unperturbed network [11] . 

Signals in the neural network are transferred within the 
cells by an electric action potential, and between cells 
by chemicals that are detected by specific receptors at 
the synapses. The major types of receptor that a neu- 
ron has are receptors of type AMPA and NMDA for the 
excitatory neurotransmitter glutamate, and receptors for 
the inhibitory neurotransmitter GABAa- In the exper- 
iments reported here the NMDA and GABAa receptors 
were completely blocked by their antagonists (2R)-amino- 
5-phosphonovaleric acid (APV) and bicucuUine respec- 
tively, leaving AMPA as the dominant receptor. Thus 
inhibition is practically turned off, and we measure a net- 
work that is uniquely excitatory. 

CNQX is a highly specific antagonist of the AMPA re- 
ceptors, with little or no effect on other receptors. Its 
effect is to block AMPA receptors and thus reduce the 
synaptic strength. This does not directly affect the net- 
work architecture, in the sense that it does not change any 
hardwired connection (although of course, for sufficiently 
high concentrations the synapses are totally blocked, and 
at that final stage the network topology does change). 

If inhibition is not neutralized by bicuculline, then the 
balance of excitatory and inhibitory neurons is crucial for 
the behavior of the network. In the framework of our sim- 



p-3 



O. Cohen et al. 



plified model, it suffices approximate the contribution of 
inhibitory synapses by a simple subtraction to the mem- 
brane potential. This is based on known values of the 
post synaptic current in both excitatory and inhibitory 
synapses, which are similar pTlfTS] . 

For a given network with a probability distribution of in- 
put connections pfc, the pair of control parameters (m, V) 
completely determines the firing of the network. Initially, 
for the unperturbed network, m = too is much smaller 
than the average connectivity of the neurons fc = X]/c ^Pt^ 
[TT| . Hence, a small fraction of firing neurons can ignite all 
the rest, $ jumps abruptly to 1 and the GmCC comprises 
the whole network [Fig. [2ja)]. As CNQX is added, the 
connectivity decreases and to grows. Those neurons hav- 
ing less than to inputs get disconnected from the network 
and, in turn, reduce the number of inputs of their target 
neurons. The fraction $ of neurons that respond together 
to a given voltage V reduces in size. The biggest jump 
in $, which identifies the size g of the GmCC, gradually 
decreases. At a critical value m — nic, the GmCC dis- 
integrates into isolated m-connected clusters. When the 
network is fully disconnected then the neurons respond 
only to the external excitation. The value of nic is a re- 
liable and reproducible experimental measurement, and 
forms the basis for evaluating several biologically relevant 
measures of the connectivity in the neural culture [UlIIl] . 
A possibility which is ignored here but can be accommo- 
dated in the model is that m is a function of V. 

Simulations. — A random, directed graph was cre- 
ated by assigning to each vertex a number of in- and out- 
edges, according to the given gaussian distribution. The 
total numbers of in and out edges were equated by ran- 
domly removing or adding out-edges. Connections were 
made by iteratively connecting the pair of nodes with the 
highest number of available out- and in- edges. The re- 
sulting graph was randomized by switching vertices be- 
tween randomly selected pairs of edges. 

Each vertex was also assigned a random sensitivity / to 
the external voltage V, drawn from a gaussian distribu- 
tion, which was later fit to the experimentally measured 
sensitivity of the neurons in the culture. The parameters 
determining each simulation were m and the external volt- 
age V. In a typical run to. was increased from 2 to 50, and 
V was varied from VJnin to Fmax so that /(Knin) — and 
/(Knax) — 1- At each V those neurons with f{V) > 
were first ignited, which in turn excited connected neu- 
rons that satisfied the input threshold requirement. The 
total fraction of nodes firing ^{m, V) was stored for fur- 
ther analysis. An increase of the firing response of the 
network at a single step higher than 10% was considered 
to be the signature of the GmCC g{m). We also extracted 
f*(m) for each run. All values were averaged over 10 — 50 
different realizations of random graphs created with the 
same parameters. 

Comparison of Simulation and Experiment. 

Figure [2] shows the comparison of a particular realization 
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Fig. 2: (a) Experimental ^(V) curves for gradually higher 
concentrations of CNQX, between and 10 /^M, and with 
m = mo(l + [CNQX]/A'd), where K^ = 300 nM and mo = 15. 
(b) ^{V) curves from a numerical simulation of the model with 
a gaussian Pk{k), fc = 40 and a — 20. Vertical bars show the 
size of the GmCC g. The insets show the corresponding size of 
the GmCC as a function of m. For the experiments, the values 
of g are averaged over two consecutive ^{V, m) explorations of 
the network. Lines are a guide to the eye. 



in the simulation to a single experimental run. Both exper- 
iment and a single simulation include fluctuations in the 
choice of the connections, and are therefore noisy. Still, in 
both cases a finite / is needed to induce the transition to 
a GmCC, and the emergence of a critical rric occurs in a 
similar way. The inset shows a detail of the development 
of the GmCC as a function of the input threshold to. 

A particularly relevant comparison of experimental and 
simulation results is obtained as the experimental densities 
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Fig. 3: Main plot: Experimental g{m) curves for 3 different 
neuronal densities (open symbols, each data set averaged over 
4 experiments) are fitted to numerical simulations of the model 
for Pk(k) gaussian (red, each curve averaged over 5 realiza- 
tions). The values in red indicate the parameters of the simu- 
lations: fc, a and the outer cutoff fcjjji„. In all cases fe^i^ = fcmin. 
The grey triangles show the numerical integration of the model 
for fc = 78 and o = 25, compared to numerical simulations with 
the same parameters and for fcJni„ = 27, k'^^^ = (blue dashed 
line, average over 10 realizations). Inset: average connectivity 
k (extracted from the simulations) as a function of the density 
p of the neural culture. 



of neurons is varied. The effect of increasing the density 
is to increase the average connectivity k that character- 
izes the distribution pk [H] • Figure |3] shows the measured 
transition curves of g as function of m at different den- 
sities. The curves are characterized by the presence of 
a plateau g{m) ~ 1 for low values of m. The GmCC 
gradually decreases for higher to, and disappears at the 
transition point tUc. 

In the simulations, the distribution pk has to be varied 
in order to follow the experimental behavior. The connec- 
tivity is described by gaussians with increasing k and a. 
To reproduce the experimental plateau, however, a cutoff 
K^in in both the input i and output o degree distributions 
has to be applied, so that p\°{k) — for fc*'° < k]^:^^. 
Overall, as seen by the red lines in Fig. [31 the agreement 
of simulation and experiment is striking, and the variation 
of TO-c is exactly reproduced. More important, as the in- 
set shows, the change in experimental neuronal densities 
is linearly related to the changes in average connectivity 
of the simulation. 



quantitative agreement of the simulation with the exper- 
iment, for example for to, == 49 in the model g — Q while 
in the experiments it is still non-zero at g = 50. Further- 
more, measuring average quantities means that we may be 
describe only the majority of the population, while some 
small fraction of the neurons, too small to disrupt the av- 
erage properties, may obey statistics that deviate from the 
gaussian distribution. 

The only sign of a deviation of model and simulation 
appears when we introduce the lower cutoff in the distri- 
bution of both the input and output connectivity. This 
was crucial for reproducing the plateau that characterized 
g{m) for low m in the experiment. If the cutoff was applied 
either to only the input or only to the output distribution 
then the numerical simulations did not give this plateau 
(dashed line in Fig. [3]). As for the model, the cutoff in 
the input distribution (the model disregards the output 
distribution) had practically no effect on the response of 
the network (grey triangles in Fig. |3]). 

Discussion. — The existence of a 'threshold', or the 
demand for a 'quorum' of inputs lies at the heart of Inte- 
grate and Fire models of the neuron |17| , and is basically 
what allows for computation in neuronal ensembles [18] . 
Similar mechanisms may be at work in diverse systems 
such as the creation of public opinion, in which people 
hear many views before they make their mind up |19| . 
and where / would be construed as external forcing such 
as the effect of the media. We believe that the QP model 
supplies a quantitative framework in which to study such 
processes. In this system, the demand for "more" neuronal 
inputs leads to a "different" transition and to a more com- 
plex threshold behavior \W. 

The major departure of the QP from standard percola- 
tion is in the ignition process. The need for a significant 
fraction /* of the network to be initially activated, and 
the dependence of /* on m, is a unique characteristic of 
the system. We believe that the deviation of the simulated 
and experimental results from the tree-like model occurs 
due to the existence of loops, which would be important 
exactly in the region of small excitations that lead to ig- 
nition of the whole network. Many loops accelerate the 
propagation of the firing cluster and thus the initial frac- 
tion /* may decrease even to zero [10 . The possibility 
of incorporating inhibitory neurons directly in the model 
would also be interesting. We furthermore expect that 
studies of the behavior of f*{m) and of rric for different 
degree distributions will yield a rich variety of phenomena. 



Comparison of Simulation and Model. The 

model and simulation fit very well when using the gaus- 
sian distribution of the connections. In a way, this is both 
encouraging and surprising, since the simulations carry a 
large number of loops (the number of directed triangles 
can be estimated by fc^/6 ~ 8 x 10^), while the model 
assumes no loops. This leads to some discrepancies in the 
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